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(54) ROBUST REINFORCE LEARNING SYSTEM 
(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a method for 
learning robust control which is relatively resistant to 
the fluctuation of an environment capable of complying 
even with the case that an environment model is 
unknown and to provide a robust controller. 
SOLUTION: This system is provided with an action 
generator (2) having a learning function and also 
outputting an action signal u (t) to an environment (1), a 
disturbance generator (4) having a learning function and 
also outputting a disturbance signal w (t) to an 
environment, and a state evaluator (3) generating an 
evaluation signal q (t) being a reward signal obtained by 
adding a reward corresponding to the level of 
achievement of a target with a reward corresponding to 
resistance to disturbance from the disturbance 
generator, and predicting the expected value of the sum 
of the evaluation signals to be obtained from the present 
state x (t) to the future, and generating the prediction 
error signal. Then, the action generator learns to 

maximize the expected value of the sum of the evaluation signals to be obtained from the 
present state to the future, while the disturbance generator learns to minimize the expected 
value of the sum of the valuation signals. 
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